Hierarchically Categorized Performance Evaluation Criteria for Intelligent Surveillance System

In urban transit station, the use of analog CCTV surveillance system has increased to detect and prevent crimes, terrors, suicides, fires and so on. But these systems have problems that system operators have to monitor consistently the scenes in transit station and they cannot quickly cope with crimes, terrors, and fires. So, it is necessary to adopt intelligent surveillance system, which may play an important role in for these problems. This system automatically analyzes image sequences acquired from various cameras and recognizes context/environment, so they can cope with crimes and terrors in real-time. It is therefore very important to develop this system and necessary to establish performance evaluation criteria to evaluate the system and improve the performance of the system. Many evaluation criteria have been presented in previous research but they are not classified properly according to the purpose of evaluation. We categorize these criteria hierarchically to help making a decision to select proper metrics according to specific application domain, such that intelligent surveillance system in urban transit station.